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Abstract 

In the context of quantum information theory, "quantization" of various mathemat- 
ical and computational constructions is said to occur upon the replacement, at various 
points in the construction, of the classical randomization notion of probability dis- 
tribution with higher order randomization notions from quantum mechanics such as 
quantum superposition with measurement. For this to be done "properly", a faithful 
copy of the original construction is required to exist within the new "quantum" one, 
just as is required when a function is extended to a larger domain. Here procedures 
for extending history dependent Parrondo games, Markov processes and multiplexing 
circuits to their "quantum" versions are analyzed from a game theoretic viewpoint, and 
from this viewpoint, proper quantizations developed. 

1 Introduction 

For the most part, mathematicians view games as functions, a point of view that allows the 
enlargement of the sets of possible strategies, outcomes and solutions in a game without 
necessarily eliminating the players abilities to play the original game in the new context. 
One way this is achieved is by identifying a game with its payoff function and then extend- 
ing this function's domain. Since an extended domain necessarily restricts to the original 
one, the original game can be recovered from the new "extended" game when appropriate 
restrictions are introduced. This allows meaningful comparison between the game theoretic 
properties of the two versions of the game. The use of domain extension is ubiquitous in 
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game theory and is most commonly recognized in the form of mixed strategies, that is, 
randomizations between the so-called pure strategic choices of a player. 

To elaborate, recall that a key goal in the study of multi-player, non-cooperative games 
is the identification of potential Nash equilibria. Informally, a Nash equilibrium occurs 
when each player chooses to play a strategy that is a best reply to the choice of strategies 
of all the other players. In other words, unilateral deviation from the choice of strategy at a 
Nash equilibrium by any player cannot improve that player's payoff in the game. However, 
Nash equilibria need not be optimal and in other cases they may not even exist. In such 
situations, games are frequently "enlarged" via the definition of an extended set of strategic 
choices and an analysis of the extended game performed. As an example for finite games, 
passing to mixed strategies often gives rise to Nash equilibria in the "mixed game" that sim- 
ply do not exist in the original game. Formally, the mixed game results from an extension 
of the domain of the payoff function to include randomization between the pure strategies 
in the form of probability distributions over the pure strategies. That mixed strategies arise 
from domain extension is also clear from the fact that a faithful copy of every pure strategy 
set sits inside the corresponding mixed sttategy set by considering a pure strategy as played 
with certainty. The so-called mixed strategy equilibria sit outside the collection of pure 
strategies within the mixed ones, and are thus considered as "new" equilibria of the original 
game. 

About a decade ago, Meyer [ 1 2] proposed the extension of the domain of a game's pay- 
off function so as to include quantum mechanical operations. A concrete example of such 
an extension was provided soon after by Eisert, Wilkens, and Lewenstein [ ], and applied 
to the game Prisoner's Dilemma. The area of study arising from these ideas has come to 
be known as quantum game theory. Typically, research in the subject looks for different 
than usual behavior of the payoff function of an n player game under quantization, that 
is as mentioned above the replacement at various points in the payoff functions definition 
of probability distribution by quantum superposition and measurement. This typically in- 
volves the replacement of strategic choices or of a family of outcomes by qudits, that is 
quantum systems having d "pure" quantum states. Also typically, quantum operations on 
each qudit are then considered as a set of quantum strategies for the players. The different 
than usual behavior is often the occurrence of Nash equilibria that were unavailable in the 
original game. Following these heuristics produces a quantized game which is referred to 
as a quantization of the original game. 

Because of the lack of explicit reference to any mathematically formal approach of 
domain extension, these heuristics sometimes produce quantizations that are not true exten- 
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sions. In such cases, it is impossible to meaningfully compare any game-theoretic results 
that these quantization generate, such as Nash equilibria, with the results from the original 
game. Indeed, such quantizations truly "change the game". On the other hand, proper quan- 
tizations are true extensions and necessarily restrict to the original game, making possible 
meaningful comparison between the results of the original game and the quantized one. A 
formal approach to game quantization via generalizing mixtures developed by one of the 
authors [2] is utilized herein to develop proper quantizations of history dependent Parrondo 
games. 

It should be noted that games are not the only informatic or computational constructions 
and processes currently undergoing extension and analysis via quantization. Two prominent 
areas of study are Markov processes [ ] and the so-called multiplexing circuits [ ]. Con- 
cerns regarding the existence of faithfully embedded versions of the classical object within 
the quantized one have also arisen in these areas. 

The problems here are also more subtle, because in these areas it is stochasticity, as 
opposed to probability distribution, serving as the classical component of the construction 
being replaced by quantum mechanical operations. In particular, the frequently consid- 
ered replacement quantum concept of completely positive operators and measurement for 
Markov processes [10] is also more general than just (normalized) quantum superposition 
and measurement, forming what in game theoretic language might be termed mixed quan- 
tum superposition, i.e. a non-trivial probability distribution over the collection of superpo- 
sitions. By jumping to this most general form of quantum probability, the existence issue of 
faithfully embedded copies of the classical process becomes clouded. As illustrated here, 
and discussed in more detail in a subsequent publication [3], clarity on this issue is gained 
by initially restricting consideration to quantum Markov processes obtained through the re- 
placement of stochasticity by (normalized) quantum superposition and measurement, and 
subsequently following to the more general situation. 

As for quantum multiplexing circuits, motivated by the similarity between the informa- 
tional behavior of classical multiplexing circuits and certain quantum logic circuits, Shende 
et al coined the term quantum multiplexer for the latter in [ ] . To be precise, some of the 
bits in a multiplexing circuit are acted upon by appropriate logic gates under the control 
of the logical values of some other bits in the circuit. Quantum circuits exhibiting a sim- 
ilar structure, such as the one for the controlled-NOT gate, are also considered under this 
formulation as quantum multiplexers. However, this definition of a quantum multiplexer 
is far too informal, allowing for the possibility that a given classical multiplexer may be 
identified with a whole class of distinct quantum multiplexers. Thus the relation between 
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a multiplexer and its "quantizations" is not functional but relational, and the question of 
preservation of a faithful copy of the original multiplexer in the quantized one becomes ill 
defined. A functional relation between the original and quantum versions of a particular 
multiplexer that arises in the context of history dependent Parrondo games is established in 
section 5, that at the same time establishes the notion of proper quantization for multiplex- 
ers. In particular within the quantum versions of the multiplexer lies faithfully embedded 
copies of the classical to which the quantum multiplexer could be restricted. 

For the Markov processes and multiplexing circuits considered here, the focus of atten- 
tion on (normalized) quantum superposition and measurement also allows the successful 
resolution of the question of what constitutes an appropriate evaluative quantum analogue 
of the stable state of a Markov process or as expressed in the context of quantum multiplex- 
ers what constitutes the appropriative evaluative initial state. As mentioned above, further 
discussion of the issues expressed in the previous paragraphs and an answer to the initial 
state question for the more general contexts appears in a subsequent publication [3]. 

2 History Dependent Parrondo Games 

Parrondo et. al first formulated such games in [ ]. The subject of Parrondo games has seen 
much research activity since then. Parrondo games typically involve the flipping of biased 
coins and yield only expected payoffs. A Parrondo game whose expected payoff is positive 
is said to be winning. If the expected payoff is negative, the game is said to be losing, and 
if the expected payoff is 0, the game is said to be. fair. 

Parrondo games are of interest because sequences of such games occasionally exhibit 
the Parrondo effect; that is, when two or more losing games are appropriately sequenced, 
the resulting combined game is winning. Frequently, this sequence is randomized which 
means that the game played at each stage of the sequence is chosen at random with respect 
to a particular probability distribution over the games being sequenced. A comprehensive 
survey of Parrondo games and the Parrondo effect by Harmer and Abbott can be found in 
[ ]. 

A special type of Parrondo games is the history dependent Parrondo game, introduced 
in [14] by Parrondo et al. This game is again a biased coin flipping game, where now 
the choice of the biased coin depends on the history of the game thus far, as opposed to 
the modular value of the capital. A history dependent Parrondo game B' with a two stage 
history is reproduced in Table 1. 

As above, let X{t) be the capital available to the player at time t. At stage t, this capital 
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Table 1: History dependent game B' . 



goes up or down by one unit, the probability of gain determined by the biased coin used at 
that stage. Obtain a Markov process by setting 



Y(t) 



X(t)-X(t-1) 
X(t- 1) -X(t-2) 



(1) 



This allows one to analyze the long term behavior of the capital in game B' via the station- 
ary state of the process Y(t). The transition matrix for this process is 
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The stationary state can be computed from the following equations 



(1 - pi)7Ti + (1 - p 3 )^3 = 7T2 

p 2 H2 + P4^A = 7T3 
(1 - p 2 )TT 2 + (1 - Pa)t^A = 7T 4 
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after setting the free variable V4 = (1 — pi)(l — Pi) and normalization constant 



N 



x E(^-) 2 = v fep 4 ) 2 + 2 [(1 - Pl ) P4 } 2 + [(1 - pxxi - P2 )y 



which simplifies to 

N = (1 -pi)(2p 4 + I-P2) +P3P4- 
Consequently, the probability of gain in a generic run of the game B' is 

Pgam N ^ (1 _ pi) (2 ^ + ! _ p2 ) + psp4 > 

where 7Tj is the probability that a certain history j, represented in binary format, will occur, 
while pj is the probability of gain upon the flip of the last coin corresponding to history j. 
The expression for p^'in simplifies to 



Pgain = V(2 + x/y) (5) 

with 

V = Pi(P3 + 1 -Pi) > (6) 
for any choice of the probabilities p\ , . . . P4, and 

x = (1 -pi)(l -P2) -P3P4- (7) 

Therefore, game B' obeys the following rule: if x < 0, B' is winning, that is, has positive 
expected payoff; if x = 0, B' is fair; and if x > 0, 5' is losing, that is, has negative 
expected payoff. 



2.1 Randomized Combinations of History Dependent Parrondo Games 

Consider now the two stage history dependent game obtained by randomly sequencing the 
games B' and B" where each of B' and B" are history dependent Parrondo games with two 
stage histories. This can be formally considered as a real convex linear combination of the 
games B' and B", where the coefficients on B' and B" are given by r, the probability that 
the game B' is played at a given stage, and (1— r), the probability that the game B" is played 
at a given stage. This is because the transition matrix of the Markov process associated to 
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the randomized sequence is obtained from the transition matrices T' and T" for the games 
B' and B" , respectively, by taking the real convex combination rT' + (1 — r)T". Explicitly, 
let 
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with ctj, 0j G [0, 1] representing the probability of gain for the j coin in games B' and 
B" respectively. Then the transition matrix rT' + (1 — r)T" of the Markov process for 
the randomized sequence of B' and B" consists of entries tj = raj + (1 — r)(0j) and 
1 — tj = r(l — a>j) + (1 — r)(l — (3j) in the appropriate locations. Call this randomized 
sequence of games B' and B" the history dependent game B'B" with probability of gain 
tj. The stable state, computed in exactly the same fashion as the stable state for the game 
B' in section 2 above, has form 



f n \ 
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(10) 



with R = 5Zj=i T j a normalization constant. Using the stable state, the probability of gain 
in the game B'B" is computed to be 



B'B" 
■fgain 



if __ 

R^ Tjtj ~ (1 
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(11) 



Just as in case of the game B', the expression for p^^" reduces to 

Pga'in" = l/(2 + x'/y') 



(12) 
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with 

y' = U{h + 1 - h) > o (13) 

for any choice of the probabilities ti, . . . t&, and 

x' = (1 - h)(l - t 2 ) - t 3 U. (14) 

The game B'B" therefore behaves entirely like the game B', following the rule: if x' < 0, 
B'B" is winning, that is, has positive expected payoff; if x' = 0, B'B" is fair; and x' > 0, 
B'B" is losing, that is, has negative expected payoff. 

It is therefore possible to adjust the values of the ctj and (3j in games B' and B" so 
that they are individually losing, but the combined game B'B" is now winning. This is the 
Parrondo effect. In the present example, the Parrondo effect occurs when 

(1 - Q3)(l - 04) > ai«2 (15) 

(l-A0(l-&)>/3i/32 (16) 

and 

(l-t 3 )(l-t 4 )<tit 2 . (17) 

The reader is referred to [ ] for a detailed analysis of the values of the parameters which 
lead to the Parrondo effect in such games. 

Restricting to the original work of Parrondo et al, a special case occurs when we con- 
sider one of the games in the randomized sequence to be of type A. That is, flipping a 
single biased coin which on the surface appears to have no history dependence. However, 
note that such a game may be interpreted as a history dependent Parrondo game with a two 
stage history where the coin used in A is employed for every history. Call such a history 
dependent game A'. The transition matrix for A' takes the form 



A 



/ p p \ 

1 -p 1-p 

p p 

\ l-p l-p J 



(18) 



Now, forming randomized sequences of games A' and B' is seen to agree with the forming 
of convex linear combinations mentioned above. In particular, as analyzed in [ ] if games 
A' and B' are now sequenced randomly with equal probability, the Markov process for the 
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randomized sequence is given with transition matrix containing the entries qj = \{oij + p) 
and 1 — qj = |[(1 — a>j) + (1 — p)] in the appropriate locations (recall that the probability 
of win for game A is p), and has stationary state 
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(19) 



Denote this randomized sequence of games A' and B' by A'-B'. The probability of gain in 
the game A'B' is 



p A'B> 
.Fgam 



1 f 
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(20) 



As in the more general case of the game B' B" , it is now possible to adjust the values of 
the parameters p and pfs in games A' and B' so that they are individually losing, but the 
combined game A'B' is now winning. This happens when 



and 



1 — p > p 



(1 - a 3 )(l - 04) > aia 2 



(1 - q 3 )(l - q 4 ) < qiq 2 . 



(21) 



(22) 



(23) 



Parrondo et al show in [14] that when p = ^ — e, a\ = — e, a 2 = «3 = f — e, 
04 = — e, and e < jgg, the inequalities (21)-(23) are satisfied. This is Parrondo et al's 
original example of the Parrondo effect for history dependent Parrondo games. 

Next we review pertinent features of the formal approach to games developed by Bleiler 
that puts game quantization in the context of domain extension. 



3 A Formal Approach to Games 

We start with a formal definition. 

Definition 3.0.1. Given a set { 1 , 2 , • • • , n} of players, for each player a set Si (i = 1 , • ■ • , n) 
of so-called pure strategies, and a set $7 j (i = 1 , • • • , n) of possible outcomes, a normal 
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form game G is a vector- valued function whose domain is the Cartesian product of the Si's 
and whose range is the Cartesian product of the fVs. In symbols 

n n 

i=l i=l 
The function G is referred to as the payoff function. 

Here a play of the game is a choice by each player of a particular strategy Sj the collec- 
tion of which forms a strategy profile (s±, ■ ■ ■ , s n ) whose corresponding outcome profile is 
G(si, ■■ ■ ,s n ) = (oji, • • • , io n ), where the u>i's represent each player's individual outcome. 
Note that by assigning a real valued utility to each player which quantifies that player's 
preferences over the various outcomes, we can without loss of generality, assume that the 
fij's are all copies of R, the field of real numbers. 

In game theory, a rational players' concern is the identification of a strategy that guar- 
antees a maximal utility. For a fixed (n — l)-tuple of opponents' strategies then, rational 
players seek a best reply, that is a strategy s* that delivers a utility at least as great, if not 
greater, than any other strategy s. When every player can identify such a strategy, the result- 
ing strategy profile is called a Nash equilibrium or occasionally just an equilibrium of the 
normal form game G. Other ways of expressing this concept include the observation that no 
player can increase his or her payoffs by unilaterally deviating from his or her equilibrium 
strategy, or that at equilibrium all of a player's opponents are indifferent to that player's 
strategic choice. 

However, normal form games need not have Nash equilibria amongst the pure strategy 
profiles. As remarked above, game theoretic formalism now calls upon the theorist to extend 
the normal form game G by enlarging the domain and extending the payoff function. Of 
course, the question of if and how a given function extends is a time honored problem in 
mathematics and the careful application of the mathematics of extension is what will drive 
the formalism for quantization. In the classical theory, the standard extension at this point is 
constructed by allowing each player to randomize between his strategic choices, a process 
referred to as mixing. 

3.1 Randomization as Domain Extension 

A mixed strategy for player i is an element of the set of probability distributions over the set 
of pure strategies S^. Formally, for a given set X, denote the probability distributions over 
X by A(X) and note that when X is finite, with k elements say, the set A(X) is just the 
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k — 1 dimensional simplex A^ -1 ) over X, i.e., the set of real convex linear combinations 
of elements of X. Of course, we can embed X into A(X) by considering the element x as 
mapped to the probability distribution which assigns 1 to x and to everything else. For a 
given game G, denote this embedding of Si into A(Sj) by e^. 

Let p = (pi, . . . ,p n ) be a mixed strategy profile. Then p induces the product distri- 
bution over the product S^. Taking the push out by G of the product distribution (i.e., 
given a probability distribution over strategy profiles, replace the profiles with their images 
under G) then gives a probability distribution over the image of G, ImG, considered as a 
multi-set. Following this by the expectation operator E, we obtain the expected outcome of 
the profile p. Now our game G can be extended to a new, larger game G mix . 

Definition 3.1.1. Assigning the expected outcome to each mixed strategy profile we obtain 
the extended game 

G mix. Y[A(Si)^ Y[Qi 

Note G mtx is a true extension of G as G mix o Hei = G; that is, the diagram in Figure 
1 is commutative. 

Having placed a game G and the corresponding game G mix in the domain extension 
context, the next natural step is to place the notions of mediated communication and cor- 
related equilibrium [ , 1 3] in a similar context. However, since the latter have no direct 
relevance tot he topic of this article, we simply refer the reader to [2] for details. 

3.2 Quantization As Domain Extension 

Classically, probability distributions over the outcomes of a game G (the image of G) were 
constructed. Now the goal is to pass to a more general notion of randomization, that of 
quantum superposition. Begin then with a Hilbert space TL that is a complex vector space 
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equipped with an inner product. For the purpose here assume that H is finite dimensional, 
and that there exists a finite set X which is in one-to-one correspondence with an orthogonal 
basis B of H. When the context is clear as to the basis to which the set X is identified, 
denote the set of quantum superpositions for X as QS(X). Of course, it is also possible to 
define quantum superpositions for infinite sets, but for the purpose here, one need not be so 
general. What follows can be easily generalized to the infinite case. 

As mentioned above, the underlying space of complex linear combinations is a Hilbert 
space; therefore, we can assign a length to each quantum superposition and, up to phase, 
always represent a given quantum superposition by another that has length 1 . 

For each quantum superposition of X we can obtain a probability distribution over X 
by assigning to each component the ratio of the square of the length of its coefficient to 
the square of the length of the combination. This assignment is in fact functional, and is 
abusively referred to as measurement. Formally: 

Definition 3.2.1. Quantum measurement with respect to X is the function 



Note that geometrically, quantum measurement is defined by projecting a normalized 
quantum superposition onto the various elements of the normalized basis B. Denote quan- 
tum measurement by q meas if the set X is clear from the context. 

Now given a finite n-player game G, suppose we have a collection Q± , . . . , Q n of non- 
empty sets and a protocol, that is, a function : f \ Qi —> QS(lmG). Quantum measure- 
ment Qj™Q S then gives a probability distribution over ImG. Just as in the mixed strategy 
case we can then form a new game G @ by applying the expectation operator E. 

Definition 3.2.2. Assigning the expected outcome to each probability distribution over ImG 
that results from quantum measurement, we obtain the quantized game 



Call the game G @ thus defined to be the quantization of G by the protocol 0. Call 
the QiS sets of pure quantum strategies for G e . Moreover, if there exist embeddings 
: Si — > Qi such that G @ o f\ e[ = G, call G @ a proper quantization of G. If there 
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Q$(jmG) 




Figure 2: Extension of the game G to G e . 



exist embeddings e'/ : A(5i) -> Qi such that G e o f\ e'{ = G mix , call G e a complete 
quantization of G. 

This formal approach to games, and in particular game quantization, is summed up in 
the commutative diagram of Figure 2. Note that for proper quantizations, the original game 
is obtained by restricting the quantization to the image of \\ e[. For general extensions, the 
Game Theory literature refers to this as "recovering" the game G. 

Though the following plays no role here, it is worth noting that nothing prohibits us 
from having a quantized game G @ play the role of G in the classical situation and by con- 
sidering the probability distributions over the Qi, create a yet larger game G m@ , the mixed 
quantization of G with respect to the protocol 0. For a proper quantization of G, G m@ is 
an even larger extension of G. The game G is described in the commutative diagram 
of Figure 3. In abstract quantum mechanics, one can access this more general notion of 
a mixed quantum operation directly via the consideration of completely positive operators 
on a quantum system, and this approach can be used to create quantum games directly. 
However in this more direct construction the importance and true role of embeddings of the 
original and mixed games is obscured, and the existence of subgames identical to the origi- 
nal and mixed games becomes problematic. This is exactly what happens in the context of 
Markov processes, see [10]. 
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Figure 3: Extension of the game G° to G m@ . 

(QJ) @/ ■ QS(\mG) ■ A (Ira G) 




Figure 4: Proper quantization of a one player game with strategy space S via the protocol O and 
quantum strategy space Q. 

3.3 Quantizing Games with Initial States 

In many cases, the Qi of the quantization protocols are expressed as quantum operations. 
These operations require a state to "operate" on. In this situation the definition of protocol 
additionally requires the definition of an "initial state" together with the family of quantum 
operations which act upon this state, along with a specific definition of how these quantum 
operations are to act. As exemplified in the following sections, different choices for the 
initial state can give rise to very different protocols sharing a common selection and action 
of quantum operations. When a protocol depends on a specific initial state /, the protocol 
is then denoted by Qj. 

In subsequent sections, a version of the formalism adapted to one player games will be 
utilized to construct quantizations of history dependent Parrondo games that are in fact do- 
main extensions. The underlying quantization paradigm being the replacement of probabil- 
ity distributions by the more general notion of quantum superposition followed by measure- 
ment. The functional diagram for proper quantization that will be utilized is given in Figure 
4 where the commutativity of the diagram requires that E o (q~^ s ) o o e = G @ o e = G. 
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Incorporating the discussion above, when games G s and protocols 0/ depend on a given 
initial states s and /, respectively, the initial states s and / are regarded as part of the single 
player's strategic choice. In these cases, the embedding e of S into Q additionally requires 
the mapping of the initial state s of G s to the initial state I of the protocol Qj. The resulting 
quantum game is denoted by Gf 1 . 

4 The FNA Quantization of History Dependent Parrondo Games 

A major insight about quantized games that results from the formal domain extension ap- 
proach to quantum games in section 3 is that for the quantization of a game to be game- 
theoretically significant, it must be proper. Previous work on the quantization of the history 
dependent Parrondo game by Flitney, Ng, and Abbott (FNA) [ ] produced quantizations 
that are not proper. In this chapter, after recalling the basic facts regarding Parrondo games 
and the FNA quantization protocols, proper quantizations for the history dependent Par- 
rondo game and their randomized sequences are constructed. 

In [ ], Flitney, Ng, and Abbott quantize the type A' Parrondo game by considering the 
action of an element of SU (2) on a qubit and interpret this as "flipping" a biased quantum 
coin. They consider history dependent games with (n — 1) stage histories, and in the lan- 
guage of the Bleiler formalism, quantize these games via a family of protocols. In every 
protocol, n qubits are required and the unitary operator representing the entire game is a 
2™ x 2 n block diagonal matrix with the 2x2 blocks composed of arbitrary elements of 
SU{2). In the language of quantum logic circuits, this is a quantum multiplexer [ ]. The 
first (n — 1) qubits represent the history of the game via controls, as illustrated in Figure 

5 for a two stage history dependent game similar to the game B' given in Table 1. Each 
protocol is defined as the action of the quantum multiplexer on the n qubits. 

The quantum multiplexer illustrated in Figure 5, where the elements Q% . . . Q4 are ele- 
ments of SU(2), operates as follows. When the basis of the state space (CP 1 )® 3 of three 
qubits is the computational basis 

B = {|000) , |001) , |010) , |011) , 1 100) , 1 101) , |110) , 1 111>> . 
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Figure 5: Part of the quantization protocol for the history dependent Parrondo game. The first two 
wires represent the history qubits. 



the quantum multiplexer takes on the form of an 8 x 8 block diagonal matrix of the form 
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where each Qj G SU{2). That is 
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with a,j , bj G C satisfying \aj\ + 1 6j | 
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For further description of the workings of the quantum multiplexer, the following con- 
vention, found in D. Meyer's original work [ ], will be used. Let a "win" or "gain" for a 
player be represented by the action "No Flip" which is the identity element of SU(2). For 
example, in Meyer's quantum penny flip game, the "quantum coin" is in the initial state 
of "Head" represented by |0) and a gain for the player using the quantum strategies occurs 
when the final orientation state of the coin is observed to be |0). This is contrast to the 
convention in FNA [ ] where |1) represents a gain. 

Now the first two qubits of an element of B represent a history of the classical game, 
with |0) representing gain (G) and the |1) representing loss (L). The blocks Qj act on the 
third qubit in the circuit under the control of the history represented by the binary configu- 
ration of the first two qubits. For example, if the first two qubits are in the joint state 1 00) , 
the SU(2) action Q\ is applied to the third qubit. Similarly, for the other three basic initial 
joint states of the first two qubits. This models the historical dependence of the game by 
having the history (G, G) correspond to the initial joint state 1 00) of the first two qubits, the 
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history (G, L) correspond to the initial joint state 1 01) , the history (L, G) correspond to the 
initial joint state 1 10) , and the history (L, L) correspond to the initial joint state |11). Thus, 
an appropriate action is taken for each history. 

Recall from section 2 that the evaluation of the behavior of the classical history de- 
pendent Parrondo game requires more than just the Markov process. The evaluation also 
requires the stable state and a payoff rule. Note that the results of applying the quantum 
multiplexer depends entirely on the initial state on which it acts. That is, different initial 
states result in differing final states. The payoff rule used by Abbott, Flitney, and Ng re- 
sembles that for the classical game in that the quantized versions are winning when the 
expectation greater than (gain capital), fair if the expectation is equal to (break even), 
and losing if the expectation is less than (lose capital). Further, as in the classical game 
this question is decided by examining the probability of gain versus the probability of loss. 
In particular, if the probability of gain is greater than |, the quantum game is winning. 

4.1 The FNA Quantization is Not Proper 

The FNA quantization protocols for the history dependent game attempt to replace the 
classical biases of the coins in the game with arbitrary elements of SU (2) and the stable 
state of Markov process describing the dynamics of the game with certain initial states of 
the qubits on which a quantum multiplexer, composed of the arbitrary elements of SU{2), 
acts. The problems with the FNA quantization protocols are two-fold. First, the attempted 
embedding of the classical history dependent game into the quantized game by replacing 
the biases of the classical coins with SU{2) elements, turns out to be relational rather 
than functional. That is, Equations (24) and (25) together give a large family of quantum 
multiplexers that the classical game maps could be mapped into, but no restrictions on the 
various choices for replacement of the biased coins that could give rise to an embedding. 
This relational mapping makes it impossible to recover the classical game by restricting the 
quantized game to the image of an embedded copy of the original. Therefore, the FNA 
quantization of the history dependent Parrondo game is not proper. 

A second problem arises from the choice of initial state. No attempt is made in FNA 
to produce an analog of the stable state of the corresponding Markov process. Instead, 
the authors merely note that different initial states can produce different results, and in 
particular focus attention on two arbitrary initial states, one the maximally entangled state 
^ (| 000) + | 111)), the other the basic state |000). In the latter, the authors assert that the 
quantum game behaves like a classical game with fixed initial history (L, L), according to 
their convention in which |0) represents loss. Note that this is not a proper quantization of 
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1 000) 



any classical history dependent game as it fails to incorporate the other histories represented 
in the stable state. For 

/ 1 \ 








V / 

and when acted upon by the quantum multiplexer in Equation (24) produces the output 

/ ai \ 

bi 






V / 

which makes the failure of the protocol to incorporate the other histories apparent. 

A similar situation occurs where only the histories |000) and |111) are incorporated. 
This protocol is also not proper as only the histories (L, L) and (G, G) are non-trivially 
represented in the initial state. For 

/ 1 \ 



1 (.) 
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V 1 J 
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(|000) + |111» 



18 



and when acted upon by the quantum multiplexer in Equation (24) produces the output 



\ 
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V2 











-64 

V 04 J 



from which, again, the failure of the protocol to incorporate the other histories is apparent. 

Thus, both of the FNA quantization protocols fail to reproduce the Markovian dynamics 
of the original history dependent Parrondo game and cannot be restricted to the payoff 
function of the original game. 

Flitney et al also consider various "sequences" of the quantum games A' and B', where 
B' is played with three qubits and quantized using the maximally entangled initial state. 
These sequences are defined by compositions of the unitary operators defining the games. 
Indeed, these sequences now produce the results presented in [ ] . These results are certainly 
novel and perhaps carry scientific significance; however, they fail to carry game-theoretic 
significance as, with respect to the classical Parrondo games, each arises from a quantization 
that is not proper. 

5 Proper Quantizations of History Dependent Parrondo Games 

In light of the Bleiler formalism discussed in section 3, constructing proper quantizations 
of games is a fundamental problem for quantum theory of games. In this section, a proper 
quantization paradigm is developed for both history dependent Parrondo games and ran- 
domized sequences of such. 

It is crucial at this stage to view the history dependent Parrondo game discussed in sec- 
tion 2 in the more formal game-theoretic context of domain extension discussed in section 
3. For this, consider the Parrondo games as one player games as a function, where the 
one player's strategic choices in part correspond to the biases of the coins. For a history 
dependent Parrondo game with two historical stages, Parrondo et al refer to these choices 
as a "choice of rules." However, the mere choice of biases for the coins is not enough to 
determine a unique normal form for these history dependent Parrondo games. In particular, 
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an initial probability distribution over the allowable histories is also required. Although any 
specific distribution suffices to uniquely determine such a normal form, as the structure of 
the game is given by a Markov process, there is a natural choice for this initial distribu- 
tion. Though this issue is not discussed by Parrondo et al, these authors immediately focus 
on this natural choice, namely, the distribution corresponding to the stationary state of the 
Markov process representing the game. 

As functions, these history dependent Parrondo games now map the tuple (P, s) into 
the element 

(7Tipi,7Ti(l -pi),vr 2 p2,vr 2 (l -_P2),7r 3 p3,7r 3 (l -p 3 ),7r4P4,7r 4 (l - Pi)) 

of the probability payoff space [0,1] x8 , where s = (tti, 7r 2 , tts, ^4) G A(histG) is the 
stationary state of the Markov process with transition matrix defined by P = (pi , P2,P3,P4) 
G [0, 1] , as in Equation (2). Formally, 

G s : [0, 1] x4 x A(histG) -> [0, 1] x8 (26) 

G s : (P,s) i-> (7ripi,7ri(l -pi),7r 2 p2,vr 2 (l - p 2 ), 7r 3 p 3 , 7r 3 (l - p 3 ), 7r 4 p 4 , vr 4 (l -^4)) 

(27) 

The outcomes winning, breaking even, or losing to the player occur when p^ in > \, 

Pga'in = 5. and^a'in < i respectively. 

Note that in this more formal game-theoretic context for history dependent Parrondo 
games, the dependence of these games on the initial probability distribution s is made clear. 
This initial probability distribution plays the role of the initial state s for the classical game 
G s appearing in the proper quantization discussion in section 3.3. 

Consider the history dependent game B' with only 2 histories. As in the FNA protocol, 
the quantization protocol for this game uses a three qubit quantum multiplexer with matrix 
representation 

/ Qi \ 

Q 2 

Q 3 
\ Q 4 j 

with each Qj G SU (2), together with an initial state. 

To reproduce the classical game, first embed the four classical coins that define the game 
B' into blocks of the matrix Q corresponding to the appropriate history. The embedding is 
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via superpositions of the embeddings of the classical actions of "No Flip" and "Flip" on the 
coins into SU(2) given either by 



or by 



N 



N* 




F 



i 
i 



-IT] 





(28) 



(29) 



with if = 1. Call the embeddings in equations (28) basic embeddings of type 1 and the 
embedding in equations (29) basis embeddings of type 2. Choosing the basic embedding of 
type 1 embeds the j th coin into SU (2) as 



Qj = ^pJN+J(l- Pj )F 



IV; 



V 1 - VPj 



(30) 



where pj is the probability of gain when the j th coin is played in the classical game B' 
given in Table 1. Note that the probabilities pj of gaining are associated with the classical 
action N in line with Meyer's original convention from [ ] where |0) represents a gain. 
Hence, the elements of the subset 

W= (|000),|010),|100),|110)) 

of B all represent possible gaining outcomes in the game. The probability of gain in the 
quantized game is therefore the sum of the coefficients of the elements of W that result 
from measurement. 

Next, set the initial state / equal to 



E 



n 

3=1 *3 



7Ti 



7To 



7T„ 



(31) 



V / 
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where the ttj are the probabilities with which the histories occur in the classical game, as 
computed from the stationary state of the Markovian process of section 2. The quantum 
multiplexer Q acts on I to produce the final state 



TT; 



(32) 



vVi 1 -P3)7T 3 
\ 7]y/(l ~P^4 J 

Measuring the state Fj in the observational basis and adding together the resulting coeffi- 
cients of the elements of the set W' gives the probability of gain in the quantized game to 
be 



P 



QB' 
gain 



1 



3=1 



(33) 



K 3=l ) V=l 

which is equal to the probability of gain in the classical game. 

This proper quantization paradigm is based on the philosophy discussed in section 
3.3. That is, a proper quantization of a classical game G s that depends on an initial 
state s requires that s be embedded into an initial state I on which the quantum multi- 
plexer acts. Here, the initial state s = {^1,^2,^3,^4) G [0,1] x4 embeds as the initial 
state / G (CP 1 )® 3 given in expression (31). The resulting game Gf 1 is the quanti- 
zation of the classical game G s by the protocol 0/ which maps the tuple (Q,I), with 
Q = (Qi, Q2, Q3, Q4) G [SU(2)] x4 to Fj G (CP 1 )® 3 given in Equation (32). Formally, 



G 7 : [5C/(2)] x4 x (CP 1 } 



(CP 1 ) 



(34) 



0/: (Q.IJh-Fj 



(35) 



By projecting on to the gaining basis W, one now gets a quantum superposition over the 
image ImG of the game G. Finally, quantum measurement produces ImG. Call Proj the 
function that projects Fj on to W, and denote quantum measurement by q me as- Then 



G B 



q„ 



ProjoO! : (Q, J) i-> ImG 



(36) 
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Figure 6: Proper Quantization, using the embedding e, of the History Dependent Game via the 
quantization protocol 6/. 

is a proper quantization of the payoff function of the normal form of classical history de- 
pendent game G s given in Equations (26) and (27). Equation (36) can be expressed by the 
commutative diagram of Figure 6, which the reader is urged to compare with Figure 4 in 
section 3.3. 

Note that by embedding s into /, the notion of randomization via probability distri- 
butions is generalized in the quantum game to the higher order notion of randomization 
via quantum superpositions plus measurement. In particular, the probability distribution 
P = {Pl>P2iP3)Pi) ^ [0, l] x4 that defines the Markov process associated with the game 
is replaced with the quantum multiplexer Q = (Qi, Q2, Q3, Qa) £ [SU(2)] x4 associated 
with the quantized game, and the stable state s of the Markov process is replaced with an 
initial evaluative state I of the quantum multiplexer. 

5.1 Proper Quantization of Randomized Sequences of History Dependent 
Parrondo Games 

Recall from section 2. 1 that randomized sequences of games B' and B" are analyzed via a 
Markov process with transition matrix equal to a real convex combination of the transition 
matrices of each game in which B' is played with probability r and B" with probability 
(1 — r). Moreover, such a sequence is considered to by an instance of a history dependent 
game denoted as B'B". 

Motivated by the discussion on proper quantization of the game Parrondo games B' 
and B" above, let us now consider a higher order randomization in the form of a quantum 
superposition of the quantum multiplexers used in the proper quantization of the the games 
B' and B" with the goal of producing a proper quantization of the game B'B". 

As in section 5, associate the quantum multiplexer Q' = (Q^Q^Q^Q'^) with the 
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game B', where 



Q' j = y /ajN + J(l- aj )F 



-y/l- ajT] 



Next, associate the quantum multiplexer Q" = (Q'{, Q'^ Q3, Q'l) with the game B", where 



Now consider the quantum superposition 



a/1 - Wjin y/Pji 



s = 7 V + 7 , V 

I iQ'i + i'Q'[ 











10>2 + 1'Q& 
iQ'z + i'Ql 



(37) 



(38) 



\ 

of the quantum multiplexers Q' and Q" with 

(7') 2 + (7") 2 = l, Wf = r, | 7 T = (l-r), y 7 " - yY = 



(39) 



and 



I'Q'i + i'Q" 



(40) 



Set the evaluative initial state in this case equal to 



/ ^1 \ 





V J 



(41) 
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where the tj are the probabilities that form the stationary state of the classical game B'B" 
given in Equation (10). The claim is that the quantum multiplexer S in Equation (37) 
together with the evaluative initial state I in Equation (45) define a proper quantization of 
the classical game B'B" in which B' is played with probability r and and B" is played with 
probability (1 — r). 

To check the validity of this claim, compute the output of £ for the evaluative initial 
state I in Equation (45): 



3 (yyr^i + 7 \/r^733X) 

•^4(7' + i'y/W) 
The probability of gain produced upon measurement of this output is 



QB'B" 
V ■ 



E l^Tj^'Vaj + 1/"y/Pji) 

L>j=i T i j=i 1 



(42) 



which simplifies to 



1 4 



(43) 



Using the conditions set up in Equation (39), the previous expression further simplifies to 
give 

4 4 

P Q X B " = r E T i K" + f 1 - »•)/%] = S E r^. 
j=i 3=1 

which is exactly that given in Equation (11) in section 5.1 for the classical game B'B". 

Again, note that this proper quantization paradigm requires mapping of the initial state 
of the classical game B'B", which is a probability distribution, into an initial state which 
the quantization protocol acts on, which is a higher order randomization in the form of 
a quantum superposition which measures appropriately with respect to the observational 
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basis. The image of the normal form of the quantum game in [0, 1] agrees precisely with 

OB 1 B 11 

£gain ■ Note that in this proper quantization of B'B , not only is the initial state of the 
classical game replaced by a quantum superposition, but also the probabilistic combination 
of the transition matrices of the classical games is replaced with a quantum superposition 
of the quantum multiplexers associated with each classical game. 

5.2 A Special Case 

Recall from section 2. 1 the classical analysis of the special case of the randomized sequence 



of history dependent Parrondo games, with r = (1 



i in which one of the games is 



A'. The game A' has the property that regardless of history, game A is always played. Such 
a sequence was considered to by an instance of a history dependent game denoted by A'B' . 
In this section, a proper quantization of the randomized sequence is shown to follow as a 
special case of the proper quantization of the classical game B'B" developed in section 5. 1 
above. 

As before, associate the quantum multiplexer Q' = Q' 2 , Q'%, Q'^), where 



Q' = ^p]N+J(l- Pj )F 



V 1 - m Vpj 



with the game B'. Now, first embed the game A into SU(2) using basic embeddings of 
type 2. That is, 



A = ^N* + y/(l- P )F* 



y/pi -p{irj) 
\/l - pirj Jpi 



The transition matrix for the game A' was given in Equation (18) and is reproduced here: 

\ 

1 - n n 1 - n n 



( p p 

1-p 1 -p 

p p 

1-p 1-p ) 



The form of A suggests that the quantum multiplexer Q" = (A, A, A, A) should be associ- 
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ated with the game A'. Now let 7' = 7" = ^in Equation (37) so that 



( A + Q[ 

A + Q' 2 



with 



A + Qj 



y/1 - pit] + y 7 ! - Pj77 



a + <7 3 

A + Q' A ) 



(VI - p{iri) + a/1 - p^) 



(44) 



With the evaluative initial state 








V 



/p 2 



//>3 






(45) 



where the pj are the probabilities that form the stationary state of the classical game A'B' 
given in Equation (19), the quantum multiplexer £ in Equation (37) defines a proper quan- 
tization of the classical game AB' when both A and B' are played with equal probability. 
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To see this, compute the output of S for the evaluative initial state I in Equation (45): 

( y/P 1 (y/Pi + y/Pl) \ 

\fPl (V 1 - Pi + V 1 - Pi) V 

y/P 2 (V 1 ~P2 + V 1 - Pi) V 

2E]=iPj VPsiVPi + y/P$ 

\/P 3 (V 1 ~P3 + V 1 - Pi) V 

y/p 4 (VPi + y/P*) 
V VP* (VI - P4 + y/1 ~ pi) V J 



The probability of gain produced upon measurement is 



gain 



M 



i=i 



1 

M 



(46) 



which is exactly that given in equation (20) in section 2.1 for the classical game A'B'. 

5.3 A Second Proper Quantization of the Randomized Sequence of History 
Dependent Parrondo Games 

A second proper quantization of the sequence B'B" can be constructed in a manner similar 
to that used to construct the proper quantization for B' in section 5. Instead of forming a 
quantum superposition of the quantum multiplexers associated with each game, first embed 
the classical coins used in the game B'B" into SU (2) as 



Yj=y/t j N+y/T=t j F 



with 



V 1 ~ fyv 



tj=raj + (l-r)/3j and 1 - tj = r(l - ctj) + (1 - r)(l - fa) 
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Figure 7: Proper quantization of history dependent Parrondo games and their randomized se- 
quences. 



and associate the quantum multiplexer Y = (Yi, I2, Y3, Y4) with the classical game B'B". 
Set the initial state, as in section 5.1, equal to 



/ 































V 






where the Tj are the probabilities that form the stationary state of the classical game 
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B'B" given in Equation (10). The output state of this protocol is 



Fi 



En 
.7=1 r i 



a/t 2 (1 - t 2 )v 
\/ r 3(l - h)v 

\ ^r 4 (l - U)rj j 

which, upon measurement produces the probability of gain 

1 



P 



QB'B'' 
gain 



1 



^=1 T o j= i 



(47) 



which is exactly the probability of gain computed in Equation (20) of section 2. 1 for the 
classical game AB' . 



6 Conclusions 

Two approaches are used to properly quantize random sequences of Parrondo games A and 
B' in which each game occurs with equal probability. One approach, discussed in section 
5, generalizes the notion of randomization between the two games via probability distri- 
butions to randomization between games via quantum superpositions. The other approach, 
discussed in section 5.3, embeds a probabilistic combination of the games into a quantum 
multiplexer directly rather than via quantum superpositions of the protocols for each game. 
In the former approach, note that it was crucial that game A was embedded into SU{2) 
using basic embedding of type 2 as this allowed for the use of the broader arithmetical 
properties, namely factorization, of complex numbers to reproduce the classical result. In 
the latter on the other hand, basic embedding of type 1 sufficed. 



7 Future Directions 

The ideas developed in this article bring together formal game theory, Markov processes, 
and quantum information theory. Due to this multifaceted nature, the study of proper quan- 
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tization of games can potentially influence research in all three areas mentioned above. 
For instance, the proper quantization protocols developed for history dependent Parrondo 
games using a particular type of quantum multiplexer lend a game theoretic perspective to 
the study of quantum logic circuits via quantum multiplexers. Indeed, the notion of the 
Parrondo effect is now attached to quantum circuits and it is now natural to investigate the 
characterization of the "quantum Parrondo effect" in quantum circuits via a game theoretic 
perspective. 

Results in quantum logic synthesis show that an n qudit logic gate can be synthesized 
via a circuit consisting entirely of variations of the quantum multiplexer [9, 4] . Given the 
interplay of game theory and quantum circuits in the quantization of history dependent 
Parrondo games, it is also natural to ask how might an arbitrary quantum logic gate be 
synthesized via a quantum multiplexer circuit in a game theoretically meaningful way. For 
example, after assigning a fixed number of qubits in the circuit to each "player", for an arbi- 
trary quantum logic gate U, how might U be decomposed into a quantum multiplexer circuit 
and an initial state chosen such that a given game theoretic outcome might be realized? 

In an even broader context, to date there is no agreement in the literature on exactly what 
a quantum Markov process is. One difficulty lies with the formulation of an appropriate 
definition of the "quantum" analogue for the stable state of a classical process, an object 
here called the evaluative state. Our quantizations of history dependent Parrondo games are 
specially quantized Markov processes involving specific elements of the Lie group SU(2) 
and with evaluative states chosen game-theoretically. A more general situation exists in 
which arbitrary elements of SU (2) are utilized. In such a situation, one asks if it is possible 
to use quantum game theory to come up with a natural choice for the evaluative state. 
Moreover, one also asks if it is possible to characterize a quantized version of the Parrondo 
effect in this general set up, and if so, what does such a characterization mean for quantum 
computation? 

References 

[1] Aumann, Subjectivity and Correlation in Randomized Strategies, Journal of Mathe- 
matical Economics, Volume 1, pages 67-96, 1974. 11 

[2] S. A. Bleiler, A Formalism for Quantum Games I - Quantizing Mixtures, Portland 
State University, preprint at http://arxiv.org/abs/0808.1389, 2008. 3, 11 



31 



[3] S. A. Bleiler, F. S. Khan, Quantum Markov Processes - A Game Theoretic Approach, 
Portland State University, in preparation. 3, 4 

[4] R. K. Brylinski and J. Brylinski, Universal Quantum Gates, Chapman Hall/CRC, 
pages 101-113, 2002. 31 

[5] J. Eisert and M. Wilkens and M. Lewenstein, Quantum Games and Quantum Strate- 
gies, Physical Review Letters, Volume 83, pages 3077-3080, 1999. 2 

[6] A. P. Flitney and J. Ng and D. Abbott, Quantum Parrondos Games, Physica A, Volume 
314, pages 35-42, 2002. 15, 16, 19 

[7] G. P. Harmer and D. Abbott, A Review of Parrondo's Paradox, Fluctuation and Noise 
Letters, Volume 2, Number 2, 2002. 4 

[8] R. J. Kay and N. FJohnson, Winning combinations of History-Dependent Games, 
Physical Review E 67, Issue 5, 2003. 8 

[9] F. S. Khan and M. A. Perkowski, Synthesis of Multi- audit Hybrid and d-Valued Quan- 
tum Logic Circuits by Decomposition, Theoretical Computer Science, Volume 367, 
Issue 3, pages 336-346, 2006. 3, 15, 31 

[10] Burkhard Kmmerer, Quantum Markov Processes, Chapter 4 of Coherent Evolution 
in Noisy Environments, Lecture Notes in Physics, vol. 611, Springer- Verlag, pages 
139-198, 2002. 3, 13 

[11] L. Marinatto and T. Weber, A Quantum Approach to Static Games of Complete Infor- 
mation, Physical Letters A, Volume 272, Issues 5-6, pages 291-303, 2000. 

[12] D. A. Meyer, Quantum Strategies, Physical Review Letters, Volume 82, pages 1052- 
1055, 1999. 2, 16, 21 

[13] R. B. Myerson, Game Theory: Analysis of Conflict, Harvard University Press, 1991. 
11 

[14] Juan M. R. Parrondo and Gregory P. Harmer and Derek Abbott, New Paradoxical 
Games Based on Brownian Ratchets, Physical Review Letters, Volume 85, Number 
24, 2000. 4, 8, 9 

[15] V. Shende, S. Bullock, I. Markov: Synthesis of quantum logic circuits. IEEE Trans, on 
Computer-Aided Design Vol. 25, no. 6, pp. 1000-1010 (2006). 3 



32 



